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We consider the problem of finding a trellis for a linear block code that minimizes 
one or more measures of trellis complexity for a fixed permutation of the code. We 
examine constraints on trellises, including relationships between the minima] trellis 
of a code and that of the dual code. We identify the primitive structures that can 
appear in a minima] trellis and relate this to those for the minima] trellis of the 
dual code. 


I. Introduction 

Every linear block code can be represented by a minimal trellis, originally introduced by Bahl et al. [1], 
which is a labeled graph that can be used as a template for encoding or decoding. As shown by McEliece, 1 
the minimal trellis simultaneously minimizes the maximum number of states, the total numbers of vertices 
and edges in the trellis, and the total numbers of additions and path comparisons required for decoding 
with the Viterbi algorithm. 

In this article, we examine properties of the minimal trellis representation of a code and its dual for 
a fixed permutation. A companion article [2] uses these results to examine the problem of finding a 
permutation that minimizes one or more trellis complexity measures. 

Section II reviews the subject of minimal trellises for a fixed permutation of a code. We examine the 
building blocks of such trellises and identify several different measures of trellis size or complexity. In 
Section III, we illustrate the connection between the minimal trellis of a code and that of the dual code. 
The section includes results that describe the structure and complexity of trellises for self-dual and other 
special codes. 


1 R. J. McEliece, “On The BCJR Trellis for Linear Block Codes,” submitted to IEEE Trans. Inform . Theory. 
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It can be shown in [7] that for 0 < x < 1 
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(B-6) 


Using Eq. (B-6) in Eqs. (B-4) and (B-5), we then obtain, for 0 < x < 1, 

i < A<*) < < B - 7 ) 

The upper and lower bounds given in Eq. (B-7) are both asymptotically tight in the limit as L — ► oo. So 
we can conclude that for 0 < x < 1, fL{ x ) — ^ ► 1 as L — ► oo, where the convergence is uniform in x. 
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II. Minimal Trellis Representation of a Code 

A. The Minimal Span Generator Matrix 

For any linear (n, k) block code C over GF(q) there exists a minimal span generator matrix (MSGM) 
representing C. A minimal trellis T for the code can be constructed from the MSGM. The trellis has 
n + 1 levels of vertices and n levels of edges. The vertex levels, called depths, are numbered from 0 to n; 
the edge levels, called stages, are numbered from 1 to n. Each stage of edges corresponds to one stage of 
encoding or decoding using the trellis. Each vertex at depth i represents a possible encoder state after 
the ith stage of encoding. The ith stage corresponds to the ith column of the generator matrix, whereas 
the ith depth corresponds to the “space between” columns i and i + L 

The edge span of any row of the generator matrix is the smallest set of consecutive integers (stages) 
containing its nonzero positions. The vertex span of the row is the set of depths i such that at least one 
nonzero symbol occurs before and after depth i. Using the generator matrix to encode k information 
symbols in n stages of encoding, the edge span of the jth row represents the interval of stages during 
which the jth information symbol can affect the encoder output. The vertex span of the jth row is the 
set of depths at which the jth information symbol can affect the encoder state. 

For example, the (6,3) shortened Hamming code has the minimal span generator matrix 


G = 


1 1 
0 1 
0 0 


1 0 
0 1 
1 1 


0 0 
0 1 
1 0 


(1) 


The edge spans are {1,2,3}, {2, 3, 4, 5, 6}, and {3,4,5}. The vertex spans are {1,2}, {2, 3,4,5}, and 
{3, 4}. We use the term span length to refer to the cardinality of a span. 


A remarkable result is that the MSGM simultaneously makes all of the spans as short as possible: The 
edge spans (vertex spans) for any other generator matrix representing C always contain the corresponding 
spans of some row-permuted MSGM. 2 Any generator matrix can be put into minimal span form using the 
following greedy algorithm: At each step, perform any row operation that reduces the edge span of any 
row of the matrix. I he rows of the MSGM are then “atomic codewords,” according to the terminology 
of Kschischang and Sorokine [5]. 


Each vertex or state at a given depth can be uniquely labeled using k or fewer symbols from GF(q). 
But any given state-label symbol can be reused to represent several information symbols, as long as the 
vertex spans of the corresponding rows of the generator matrix do not overlap. This reassignment of 
state-label symbols to multiple rows of the generator matrix is the key to efficient trellis representations 
of the code. 


For example, the minimal trellis T produced for the (6,3) shortened Hamming code with MSGM given 
in Eq. (1) is shown in Fig. 1. For this trellis, we can define the binary state label to be s 2 s u where s 2 = 1 
at depth i if the second information bit is 1 and i is within the vertex span of the second row, and s\ = 1 
if either (1) the first information bit is 1 and i is within the vertex span of the first row or (2) the third 
information bit is 1 and i is within the vertex span of the third row. This time-sharing arrangement for 
state bit si is possible because the vertex spans of the first and third rows do not overlap. 

In the sequel, we will be interested primarily in nondegenerate codes, which we define as codes whose 
minimum distance d and dual code minimum distance d 1 are both at least 2. Degenerate codes have a 
simple interpretation: If d < 2, the vertex span of some row of the MSGM must be empty; if d ^ < 2, 


2 Ibid. 


149 



0 1 2 3 4 5 6 DEPTH 

STATE 

S 2 S 1 
0 0 

0 1 

1 0 

1 1 

Fig. 1. A minimal trellis for the (6,3) shortened Hamming code. 

some column of the generator matrix must be identically zero. For a degenerate code, we can simply 
ignore the extraneous symbol positions (if d 1 < 2) and/or separately decode the unprotected information 
symbols (if d < 2). The code consisting of the remaining code symbols is then nondegenerate. 

B. Past and Future Subcodes 

Following Forney [3], let us define the ith past and future subcodes, denoted V l and to be the sets 
of all codewords whose vertex spans are contained in [0, i - 1] and [i + l,n], respectively. The dimensions 
of these codes can be easily determined from the MSGM: fi = dim(J r ,) is the number of rows for which 
the leftmost nonzero entry lies in column i + 1 or later, and Pi = dim(P,) is the number of rows for which 
the rightmost nonzero entry lies in column i or earlier. 3 This implies that p, and / t are monotonic, 


1 2 3 4 5 6 STAGE 



0 0 


0 = PO < P\ < ■ • < Pn = & = fo > fl > ■ ■ ■ > fn - Q 


( 2 ) 


and never change by more than 1 from one index to the next. 


For each 1 < i < n, we define the left- and right-basis indicators, l^n e {0, 1}, to identify the positions 
where the future and past dimensions change: 


li = fi-l - fi Ti=pi-Pi - 1 


For any i, k = 1 if and only if the edge span of some row of the MSGM G begins in column i, or 
equivalently, the ith column of G is linearly independent of the i - 1 columns to the left. Similarly, r< = 1 
if and only if the edge span of some row of G ends in column i, i.e., the ith column of G is linearly 
independent of the n - i columns to the right. The columns where i, = 1 and the columns where r, = 1 
each forms a basis for the column space of G, and these sets are called the left basis and the right basis, 
respectively. The positions of the left and right basis columns can be regarded as information positions 
when the generator matrix is used to encode the information left to right or right to left, respectively. 

C. Primitive Structures of a Minimal Trellis 

There are four basic building blocks that can be used to construct the minimal trellis for any nonde- 
generate code. At any given stage i, all primitive structures are of the same type, which is determined 
by the values of l x and r*. The primitive structures are 


3 Ibid. 
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(1) Simple extension (-): This primitive structure appears at stage i when = 0, r, = 0, 
e.g., stage 4 in Fig. 1. Simple extensions at stage i imply a single edge out of each vertex 
at depth i - 1 and a single edge into each vertex at depth i; hence, the number of vertices 
remains constant. 

(2) Simple expansion (<): This corresponds to l t = 1 ,r» = 0, e.g., stages 1 and 2 in Fig. 1. 
There are q edges out of each vertex at depth i- 1, and a single edge into each vertex at 
depth i, hence, multiplying by q the number of states from one vertex depth to the next. 

(3) Simple merger (>): This corresponds to k = 0,r* = 1, e.g., stages 5 and 6 in Fig. 1. A 
simple merger is a time-reversed simple expansion, reducing the number of states by a 
factor of q. 

(4) Butterfly (x ): This corresponds to U = l,r, = 1, e.g., stage 3 in Fig. 1. There are q 
edges out of each vertex at depth i — 1 and q edges into each vertex at depth i; hence, 
the number of states is constant. 

The total numbers of such primitive structures in the trellis are denoted by AL, N <t N>, and N x 
respectively. For example, the trellis in Fig. 1 has N K = 3 = Af>, N x = 2, AL = 4. Because’the graph 
has exactly one initial node and one terminal node, the total number of simple expansions must equal 
the total number of simple mergers: 


AT< =AT> 

The total number of edges in the trellis, E, can be found by counting the number of edges associated 
with each primitive trellis structure: 


E = N - + qNc + qN> + q 2 N x (3) 

Similarly, the total number of mergers M is the sum of the number of simple mergers and the mergers 
included in butterflies: 


M — N > + qN x 


( 4 ) 


If we count the total number of vertices associated with each primitive structure, then each vertex in 

the trellis (excluding initial and terminal nodes) will be counted twice, so the total number of vertices V 
satisfies 


2V-2 = 2AL +(q+ 1)AT< + ( 9 + 1 )N> + 2qN x 


which gives 

V = l+N-+(q+l)N <+ qN x (5) 

Combining Eqs. (3), (4), and (5), we find 


E _- F + l 
q - 1 


This is the generalization of the binary version of this result found by McEliece. 4 
4 Ibid. 
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D. Measures of Trellis Complexity for Viterbi Decoding 

The vertex space dimension at depth i is 


Vi = k - ft — Pi, i = 0, - • • ,n (6) 

and the edge space dimension at stage i is 

e, = k - fi - Pi-i, i = ( 7 ) 

The total number of vertices at depth i is q v *, and the total number of edges at stage 1 is f.Of course 
v . > 0 for all i since at least one vertex must exist at each depth. Also, for nondegenerate codes, e t _ l 
for all i, i.e., no stage consists of a single edge. 

The most commonly used measure of Viterbi decoding complexity for a minimal trellis is the maximum 
dimension of its state space, 


Smax 


A 


max Vi 


(8) 


This complexity metric has been cited as one of the essential characteristics of any code [6]. Similarly, 
the maximum dimension of the edge space is 


e m ax = maxe, 

i 


(9) 


Forney argues that this is a more relevant complexity measure because, unlike s max , this quantity cannot 
be reduced by combining adjacent stages of a trellis [4]. 

A different metric, used in McEliece’s derivation of the MSGM, 5 is the total length of all the edge 
spans of the rows of the MSGM: 


A 

€ — 



( 10 ) 


where £j denotes the length of the edge span of the jth row of the MSGM. A similar span length metric 
is the total length of all the vertex spans: 


3 = 1 


where v = £, - 1 is the length of the vertex span of the jth row of the MSGM. These two metrics are 
equivalent to the sums of all the edge dimensions or vertex dimensions (summed over stages or depths, 
respectively): 


5 Ibid. 
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71 

V + k = £ = y^ej = k + 


t= 1 


i=0 


of ^??^S?s t y a !,r re meanin »f Ul 0f Viterbi deCOding com P lexit y are the total numbers 

of edges E, vertices V, and mergers M, rather than simply the vertex or edge dimensionality: 6 


n 


E = 

1=1 

(ii) 

p 

o 

■W 

II 

(12) 

i=0 


M - E ‘.i"-' = l Ew - ; !>*■ 

*=i i=i q i=i q frt 

(13) 


E is equal to the number of 
<?-ary comparisons required 
proportional to E 7 


binary additions required to compute path metrics, and M is the number of 
to merge trellis paths. The computational complexity of Viterbi decoding is 


III. Minimal Trellis Representation of the Dual Code 

In this section, we explore the relationship between the minimal trellises for a code C and its dual C 1 . 


A. Past and Future Subcode Relationships 


As discussed in Section II.B, l t = 0 if and only if the ith column of the MSGM can be written as some 
form 1 C ° mb 10n ° f the 1 ~ 1 columns to its left. In other words, there exists a dual codeword y of the 


y = £XX^j__X 1 000 — 0 

t—1 n—i 


Where XXX - X denotes some sequence of symbols from GF(q). 
manner for each of the left-dependent columns in the MSGM produces 


Defining j/i,i/ 2 > • • • ,y n -k in this 
ti — k dual codewords of the form 


Vi 

= XXX ■ ■ • A1000 • • 

0 

i/2 

= XXX ■ ■ ■ 

X 1000 • • • 0 

Vn-k 

= XXX ■■ 

XI 


lawxl S mT* T ?!T Iy Iine " ly i " d 'P en f“* “<*. «™>. can be used as the tows of the generator 
matrix for C . We see that the positions where if = 1 are precisely the positions where I, = 0; the same 

rgument applied to the right-dependent columns shows that the positions where if- = 1 are precisely the 


6 Ibid. 

7 Ibid. 
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positions where r, = 0. Here l* 1 and r x are the left- and right-basis indicators for C x . These observations 
lead to the following theorem. 

Theorem 1. For each 0 < t < n, the left- and right-basis indicators for a code and its dual are related 

by 


U + r x = li + U = 1 


and the dimensions p„ f, of the pant and future subcodes of a code are given in toms of those of the 
dual code pi , ft 35 fcU° ws: 


Pi = fc — n + 1 + ft 
fi = k - i + pi 


We believe that this result, which relates minimal trellises of a code and dual for any fixed permutation 
is nmret ndlental than similar dual relationships for permutations of codes. This result is also contained 
in [4], but is derived by first considering permutations of codes. 

B. Primitive Trellis Structures for the Dual Code 

Much information about the trellis for the dual code can be inferred torn the Jtrelto 
code. For example, if the code has a simple expmrsron ^ ^ ^ ; ode also has a 

3e “p^oi aructure .“hostage. Repeating' this procedure, we find the “dual" of each primitive 
structure, shown in Table 1. 

Civen an unlabeled trellis, Table 1 can be used to determine the number and type of primitive structures 
pre^'nt'at'every deptl^of the trellis for the dual code. However, we cannot in general de.ernune the 
interconnections without additional information about the code. 

The dual relationship for primitive structures shown in Table 1 implies that 


N x = JV< = N> = iV x 


and 

N . _ = qN£ 

C. Dual-Code Complexity Measures 

The following well-known result, first noted by Forney [3], is a consequence of Eq. (6) and Theorem 1. 
Lemma. A code and its dual code have equivalent vertex spaces, namely, for each i, 

Vi = u x 
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Table 1 . Dual primitive structures. 


Code structure 

Dual structure 

Simple extension ( — ) 

Butterfly (x ) 

l t = 0, r t = () 

^ = 1 .^ = 1 

Simple expansion (<) 

Simple expansion (<) 

ii = i,n=o 

if = W = ° 

Simple merger (>) 

Simple merger (>) 

U = 0, Ti = 1 

"*l- 

II 

© 

II 

Butterfly (x ) 

Simple extension (— ) 

h = = 1 

z . x = 0, r/- =0 


« t ZTi, ™;; el " S C0mp “ ty meaSUreS ,0r * COde hy equating the 


V = V 1 

s max = «max 

e - k = V = u L = e 1 - (n - k) 


Note that this implies e = £■*■ for any rate 1 /2 code. 


The number of edges in the minimal trellis of a code and its dual is not as 
-bq. (7) and Theorem 1, 


conveniently related. From 




= e x + (1 - r x - / x ) 


for each 1 < * < ft. Consequently, since |1 - rj- - lj-\ < 1, and from the definition of E, 

-E < E 1 < qE 

q 


Equality is possible only for the degenerate (n, n, 1) code or its dual. 

D. Minimal Trellises for Self-Dual and Other Special Codes 

For self-dual codes, the theory of the previous two sections collapses neatly to yield 
because, for any such code, 1, = $ and r, = if for all i. Consequently, from Theorem 1, 

Theorem 2. For any self-dual code C, for each i = 1, 2, • • • n, either 


(1) li = 1 and ri = 0, or 

(2) ^ = 0 and r* = 1 
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i to an information symbol when encoding from one direction and a parity 

•* *“*• — *" r(c) are simple 

expansions and simple mergers, 
code. 

and vertex dimensions are equal. 

Theorem 3. For any self-dual code, 

v = SJlLe + i 

2 9 


M = -E 

2q 


There is another case where we can restrict the type of structures that can appear in the trellis for a 
code: 

code with all codeword weights divisible by some integer m > 2, then, 


Theorem 4. If C is a 


(1) There does not exist a 
structures. 

1 

(2) C cannot have rate greater than 

(3) e m ax = s max 

(4) V > ( E + 1 


position i such that Z, = r< = 1, be., T(C) contains no butterfly 


(5) M < IE 


( 6 ) < 


J- ^ t q + — \ E x + 1 


(7) M ± > 


J- ^ _L e l 


2q 


Proof: If h = n = 1, then the ^h_co^begms and eod P = where (_i) 

existence of codewords of the form x - XXX some stri of symbols OF(,). 

denotes the additive ™ be by m Thls proves (1) . non, 

~ L7,5)! rrSliS Theorem , ^ + * * >7 — <°> 

and (7). 
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Codes for which all codeword weights are divisible by some integer other than one are called divisible 
codes [7]. Examples of divisible codes include the (31,10,12) binary cyclic codes and doubly even self-dual 
codes such as the extended Golay code. 

The converse of Theorem 4 does not hold— a code is not necessarily divisible when k + r* < 1 for all 
i. If a code and its dual satisfy the conditions of Theorem 4, then the code strongly resembles a self-dual 
code: The code must have rate 1/2 and its trellis contain only simple expansions and simple mergers. 


IV. Conclusion 

In this article, we have examined the trellis complexity problem by first considering the minimal span 
generator matrix for a fixed permutation of a code. McEliece showed that the so-called minimal trellis 
indeed minimizes not only the maximum state dimension of the trellis but also a whole gamut of com- 
plexity measures. 8 Here we have augmented the list of reasonable complexity measures and interrelated 
them. We have also illustrated the connection between the complexity measures and the four primitive 
structures of a minimal trellis for a nondegenerate code. 

We developed some useful relationships between the minimal trellis of a code and that of its dual. 
The duality relationships lead to interesting connections among several of the complexity measures for 
the special case of self-dual codes. 
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